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© Solid state microscope. 

© A quantitative light microscope for viewing and 
scanning microscopic objects that uses a solid state 
detector (7) in the primary image plane. The micro- 
scope has a light source (1) with a condensor (2) 
and diffusion filter (3). A moveable stage (5) is 
provided to allow X. Y, 2 plane displacements in 
order to scan objects under the microscope. There 
is an objective (6) to magnify the image of the object 
and project this image onto a two dimensional solid 
state image sensor (7) positioned in the primary 
image plane of the objective. The solid state image 
sensor (7) sends signals to an analog-to-digital con- 
verter (8) where the signals are digitized and sent to 
a frame memory (9). A monitor (10) is used to 
display the image of the object as stored in frame 
^ memory. The present invention can be interfaced 
^with a computer (12) to allow for automatic focusing 
.and scanning of an image. The computer also 
q houses storage means to store images. Methods of 
O) scanning an object are also described. A prism 
Q element can be used to obtain spectral scans of an 
§ object. In another scanning method, a first edge row 
CO of pixels is used to detect an object of interest in the 
Q scanned image. This first detection row activates an 
area of the sensor array at a later time to capture the 
^entire image. In this way, only relevant information is 
collected and processed. 
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QUANTITATIVE LIGHT MICROSCOPE USING A SOLID STATE DETECTOR IN THE PRIMARY IMAGE PLANE 



This invention relates to a quantitative light 
microscope that uses a solid state detector in the 
primary image plane and to a method of displaying 
and processing images. When the solid state de- 
tector is a charge-coupled device (CCD) the inven- 
tion may be described as a CCD-microscope; in its 
general form the invention may be described as a 
solid state microscope. 

For many applications where microscopy is 
used in bioidgy. medicine, material 'science, etc.. 
images have to be electronically captured and 
digitized for the purpose of storage or image'pro- 
cessmg. This task may be done using an optical 
compound microscope conventional microscope 
equipped with a video detector including those 
video detectors where a charge-coupled device 
(CCD) is used as the image sensor. The signals 
from the video detector are transformed into video 
signals, which can then be digitized using a frame 
grabber further processed using a digital signal 
processor and stored in a frame memory. Since 
video signals are based on the TV Broadcast Stan- 
dard and are analog signals they are not optimal 
for quantitative image processing. Furthermore, the 
optical paths in such systems are generally com- 
plex: apart from the objective of the microscope, 
the light passes through beam-splitters or is re- 
flected by semitransparent mirrors and it then 
passes through at least one magnifying lens which 
can be an ocular or a projection lens. Hence, there 
are many optical elements through which the light 
must pass before it reaches the video detector. 
This introduces an inherent degree of distortion 
and aberration of the image as well as significant 
light losses. 

Numerous digital, image microscope devices of 
the above type are commercially available. A host 
of large and small companies provide a variety of 
options for image processing techniques. Examples 
include systems from Zeiss (IBAS 2000). Becton 
Dickinson. (CAS 200) Cambridge Instruments 
(Quantimet 920/970) and Leitz (TAS Plus). Indeed, 
such devices have found extensive use in material 
science and elsewhere. When used in cell biology 
and medicine, they are generally referred to as 
image cytometry devices. In most cases the image 
detector is a video camera from which a frame can 
be captured by a frame grabber. The digitized 
image can then be manipulated by a variety of 
techniques using computers or specialized imaging 
processors. 

An alternate approach in capturing images is to 
use the dynamic microscope image processing 
scanner developed by Palcic, Jaggi and Nordin 
disclosed in U.S. Patent 4,700,298. For this device. 



the image sensor is a solid state CCD device 
consisting of a linear array of photodetectors. The 
image can be acquired through the microscope 
optics by moving the sample on a precision micro- 

5 scope stage in one micron steps in a manner 
synchronized with capturing individual lines. Alter- 
natively, the image can be scanned by moving the 
sensor across the magnified microscope image. A 
similar approach to this method is found in United 

70 States Patent No. 4.398.211 to Young which uses a 
linear solid state image sensor with a galvanometer 
scanning mirror (adding yet another mirror and a 
mechanical element to the system) for scanning in 
one of the two orthogonal directions while the sen- 

15 sor scans the other direction. 

All the above systems surfer a significant de- 
gree of deterioration of the image due to the large 
number of optical and mechanical elements in a 
compound microscope. Those systems which use 

20 video detectors suffer additional deterioration of the 
image because the transformation of the detected 
light intensities into a video signal represents a 
distortion of the original image. Also, many video 
cameras have an aspect ratio of typically 4:3 or 5:3 

25 in the case of high definition television cameras. 
This makes computation of x f y functions of the 
image difficult and generally further distorts the 
true image. Additional problems in quantitative 
microscopy using video cameras include interlac- 

30 ing and automatic gain control. The small field of 
view imposed by the microscope video systems 
makes it difficult to search visually for objects. In 
the case of acquiring images using scanning meth- 
ods with a linear array, as with the dynamic micro- 

35 scope image processing scanner of United States 
Patent 4.700.298 to Palcic et ai. or United States 
Patent 4,398,21 1 to Young, the image is digitized in 
discrete quantities and the pixels are squared. 
However, optical distortions due to the use of mi- 

40 croscope optics still exist, and most importantly, 
acquiring images in real time is generally not pos- 
sible. A typical image can only be obtained in a 
few seconds. 

Finally, even when one is able to obtain an 

45 image, irrespective of the time it takes or distor- 
tions it may have, one is in no position to know 
beforehand which part of the image is of interest 
and which part is not. For example, a small cell 
may exist in a large field of view; only the cell is of 

so interest, yet most pixel data are of the background 
which holds no useful information. In a conventional 
system, the entire image has to be processed 
before one finds the object(s) of interest. This is a 
time consuming operation, generally preventing 
analysis of data in real time. 
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The present invention circumvents these prob- 
lems by projecting the image directly, through one 
high resolution lens (an objective), onto a large 
two-dimensional CCD-array or similar solid state 
image sensor positioned in the primary image 
plane. Accordingly, the present invention is a solid 
state microscope comprising: 
a light source with a condensor and diffusion filter; 
a moveable stage to provide X, Y and Z displace- 
ments to position and scan an object under the 
microscope; 

an objective which is highly corrected for aberra- 
tions and with a large numerical aperture and an 
ultrawide flat field to project magnified images of 
the object onto a two-dimensional solid state image 
sensor positioned in the primary image plane of the 
objective, the image sensor having a large sensing 
area with a high pixel density and generating sig- 
nals corresponding to the spatial distribution of the 
luminance levels of the images; 
an analog-to-digital converter associated with the 
solid state image sensor to digitize and process the 
signals of the solid state image sensor in order to 
provide digital images of the object; 
calibration and correction means coupled to said 
analog-to-digital converter for enhancement of the 
digital images and to account for optical and detec- 
tion induced distortions; 

a frame memory coupled to said calibration and 
correction means into which the digital images are 
continuously downloaded; 

image processors associated with the frame mem- 
ory for processing the digital images; and 
display means coupled to the frame memory for 
displaying the image. 

With the present invention, there is a minimum 
deterioration of the image as a single optical ele- 
ment (the objective) is used to project the image 
onto the soiid state image sensor array located in 
the primary image plane of the objective lens. In 
the art of microscopy the 'primary Image plane' 
may also be referred to as the intermediate image 
plane, or the principle image plane. The sensed 
discrete image Is digitized, conditioned and pro- 
cessed in real time and may be displayed on a 
high resolution RGB-analog monitor or any other 
read-out device that accepts a digital signal. The 
solid state Image sensor comprises a two dimen- 
sional array of individual detectors which are 
square pixels of a few micrometers. The discrete 
analog signals from individual pixels are directly 
digitized and are never transformed into a video 
signal. The signals from the entire array of detec- 
tors or from parts of the array can be processed 
and displayed on demand. 

Selected individual lines or selected portions of 
the array can be captured, processed or stored. 
These local areas or pixels can be predetermined 
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or they can be selected under dynamic conditions. 
In such applications, It may be advantageous if the 
two-dimensional detector array is a Charge Injec- 
tion Device (CID). This solid state image sensor 

5 makes random access of pixels of the image par- 
ticularly easy. For example, a processed signal of a 
pixel or a line of pixels could be used to trigger 
activation of a selected area of the array to capture 
an image limited to that area. In this way, only the 

70 minimum data needed for analysis of selected ob- 
jects need be processed. 

Aspects of the invention are illustrated, merely 
by way of example, in the accompanying drawings, 
in which: ^ ' 

rs Figure 1 is a schematic block diagram show- 

ing a preferred embodiment of the present inven- 
tion which uses light transmitted through the object 
to be viewed to project an image onto the solid 
state image sensor. 

20 . Figure 2 is a simplified flow chart illustrating 
the operation of the sdlid state microscope. 

Figure 3 shows a monitor printout of stained 
human red and white blood ceils as viewed using 
the present invention with a 3 level contour plot of 

25 a portion of the monitor printout also shown; 

Figure 4 is a schematic block diagram show- 
ing another embodiment of the present invention 
which uses light reflected from the object to be 
viewed to project an image onto the solid state 

30 image sensor. 

Figure 5 shows a further embodiment of the 
present invention which utilizes a prism to project 
spectral scanlines of an object onto the solid state 
image sensor. 

35 Figure 6 is a two dimensional image of white 

and red blood cells generated using spectral scan- 
lines of two different wavelengths as shown in 
Figure 5; and 

Figure 7 illustrates the solid state image 
40 sensor scanning method of the present invention 
where only that part of the array containing the 
image of the object of interest is processed by the 
solid state microscope. 

Figure 8 is a simplified schematic view 
45 showing a conventional compound microscope. 

Figure 9 is a simplified schematic view of a 
solid state microscope according to the present 
invention. 

Referring to figure 1, a transmittance mode 
so embodiment of the present invention is shown 
schematically comprising a light source 1, with a 
condensor 2, diffusion filter 3 and optional filter 4, 
an x, y, z stage 5 which is driven by stepping 
motors, controlled by a controller 13 with a joystick. 
55 an objective 5. two-dimensional solid state image 
sensor 7, an analog-to-digital converter 8, a frame 
memory with image processors 9, a computer 12. 
a large screen monitor 10. and a cursor control 11. 

3 
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Figure 4 shows a reflecting light embodiment of the 
present invention in which the light source 1 illumi- 
nates the object to be viewed in such a way as to 
reflect the image of the object into the objective 6. 
The only difference between these two embodi- 
ments of the present invention is the arrangement 
of the light source 1 , condenser 2, diffusion filter 3 
and optional filter 4 relative to the object to be 
viewed. 

The light source 1 is a powerful, stabilized light 
source, emitting from the near infrared to shorter 
ultraviolet wavelengths. Examples include a halo- 
gen or mercury source or a tunable laser. These 
light sources together with condensor 2 are com- 
mercially available (e.g. Optikon Inc. or Nikon 
Canada Inc.) as are the stabilized power supplies 
(e.g. Xantrex Technology Inc. or Kikusui Electronics 
Corp.). Whenever a light source of a selected spec- 
trum is required, special filters 4, optical prisms or 
monochromators can be employed. For work in the 
ultra violet or infrared region of the electromagnetic 
spectrum, light sources of desired spectral output 
can be selected. Generally, the performance of the 
solid state image sensor 7 has to be matched to 
the selected wavelength of the selected light 
source 1 . 

It is desirable that stage 5 for holding a sample 
is motorized allowing precise step-wise movements 
in the x.y.z directions. In a preferred embodiment 
of the present invention, stage 5 is moved by 
stepping motors capable of movements of 0.1 mi- 
crometers, 0.25 micrometers or 1 micrometer per 
step, depending on the desired precision and ve- 
locity of the movements in the x,y and z directions. 
Such precision drives are available from manufac- 
turer's such as Gebruder Marzhauser. Wetzlar 
GmbH. Controller 13 controls the stepping motors, 
thereby controlling the number of steps, and the 
speed with which the steps are made including 
acceleration and deceleration of the stage 5. 
Present day controllers are capable of sending up 
to 20.000 steps per second in all three directions 
simultaneously (e.g. Lang-Electronik GmbH). Con- 
troller 13 is preferably under computer control to 
allow automatic focusing of the solid state micro- 
scope. Alternatively, stage 5 may be controlled 
using the joystick provided with controller 13 to 
allow manual movement of stage 5. 

The objective 6 is a critical part of the system. 
It is desirable that a changeable, large numerical 
aperture (N.A.) objective be used. Using visible 
light, the minimum distance between two adjacent 
points which can still be resolved is limited to 
approximately 0.15 micrometers. Optical resolution 
R is limited by the expression: 



2 N.A. 

where X is the wavelength of the light source used. 
Hence, even a high power objective with a projec- 
tion or ocular lens would not improve the theoreti- 
cally achievable resolution of 0.15 micrometers, 
which can be provided by a low power, high nu- 
merical aperture objective using visible light. An- 
other aspect of the high numerical aperture objec- 
tive and the omission of one additional ocular mag- 
nification is a significant improvement in illumi- 
nance since illuminance I is approximately propor- 
tional to (N.A) 2 / M 2 where N.A. is the numerical 
aperture of the objective and M is the microscope 
overall magnification. It is also important to use an 
objective 6 which gives a flat with a minimum of 
aberration and distortion image in the primary im- 
age plane where the flat two-dimensional image 
sensor 7 is located. Objectives that deliver a flat 
image are known as Plan Apochromat lenses and 
are commercially available from companies such 
as Zeiss Canada Inc.. Leitz-Wild AG, or Nikon 
Canada Inc. 

Together with the objective 6. the solid state 
image sensor 7 is the most important part of the 
solid state microscope. Only recent advances in 
CCD and VLSI (Very Large Scale Integration) tech- 
nology have made large arrays of sensors available 
that are appropriate for the present invention. In a 
preferred embodiment of the present invention, the 
two-dimensional solid state image sensor is a 
Charge-Coupled Device (CCD) having over one 
million individual pixel elements in over 1,000 rows 
and over 1,000 columns of less than size 10 mi- 
crometers x 10 micrometers (pixel density larger 
than 10.000 pixels per square millimeter). These 
requirements are based on Nyquist theory and 
experimental results. Several large area, small pixel 
size sensors are commercially available, e.g.: Tex- 
as Instrument 1024 x 1024 pixels with 10 microm- 
eter x 10 micrometer pixel elements; Kodak KAF 
1400, 1320 x 1035 pixels with 6.8 micrometer x 6.8 
micrometer pixel elements. Alternatively, a Charge- 
Coupled Photodiode (CCPD) or Charge Injection 
Device (CID) or any other two dimensional solid 
state image may be used provided the sensor 
yields sufficient spatial or photometric resolution. 
Preferably, the solid state image sensor 7 is cooled 
to provide a better signal-to-noise ratio, lower dark 
currents, decreased crosstalk and greater dynamic 
range, creating a more sensitive image sensor and 
making longer integration times possible. Cooling is 
achieved by thermo-electrical cooling devices (for 
example Marlow Industries, Inc). For much lower 
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temperatures, e.g. below 240K. a cryogenic cooling 
system can be employed (e.g. Cryosystems Inc.). 

When an image is projected onto the solid 
state image sensor 7. each pixel element of the 
sensor array generates a signal corresponding to 
the brightness level of the image light falling on the 
image sensor array. As shown in Figure 2, the 
signals generated by the image sensor 7 are trans- 
ferred to an analog-to-digital converter 8 where 
they are digitized in real time. The signals are then 
transferred to calibration and correction means 
comprising correction circuit 15 where they are 
corrected for electronic offset and gain. Such a 
correction circuit allows one to fully calibrate the 
system taking into account optical and detection 
induced distortionSi In a preferred embodiment, 
each image is calibrated in real time. This is 
achieved by subtracting and normalizing the back- 
ground image and correcting the signal using the 
formula: 



ib-id 

where l c the calibrated (sometimes described also 
as decalibrated) image, lj is the uncorrected image, 
l b is the image of the background light without an 
object (bright image) and l d is the image of com- 
plete darkness (dark image) of each pixel; K is a 
constant An alternative calibration procedure is the 
substraction of the light image I from the uncor- 
rected image I; plus a positive offset. In both ways, 
uneven illumination, imperfection of the objective 
and uncorrected signal amplification of the solid 
state imaging array are eliminated from the cali- 
brated image. After treatment by the correction 
circuit 15, the calibrated digital image is continu- 
ously downloaded into a frame memory unless the 
image is held for measurement 

The frame memory 9 with associated image 
processor(s) 20 must be capable of processing and 
displaying data in real time. The image processors 
20 provide filtering and feature extraction process- 
ing (e.g. filtering, convolutions, FFTs, etc.) in order 
to produce an image suitable for display on RGB 
analog monitor 10. Also, signal averaging should 
be available for better quality of images. Such 
image processors for video systems are already 
commercially available (e.g. MVP-AT/NP, Matrox 
Electronic Systems Inc.) and similar processors 
can be built with a direct pixel by pixel digitization. 

Colour information about the object for viewing 
as well as for image processing purposes, can be 
achieved in several ways. In a preferred embodi- 
ment three images are obtained in sequence using 



red, green and blue bandwidths as the light source. 
The three images are then combined into an 
RGBanalog signal. Other alternatives include the 
use of several detectors or using only a portion of 
5 a single detector for each colour. Colour and/or 
spectral Information can be used to selectively 
detect or outline objects of the image and to char- 
acterize the image. 

The images produced by the image processors 
w 20 are displayed on a high resolution RGB-analog 
monitor 10 where the whole image or a part of the 
image can be viewed; hence no ocular lens is 
required. This type of viewing is more convenient 
and in addition the actual digital image on which 
;s the measurements are performed is observed rath- 
er than the optical image. The monitor image can 
be overlayed with a cursor to allow for measuring 
and selecting objects of interest. Such a cursor 
would be manipulated using cursor control 1 1 op- 

20 erating through computer 12. Ideally, the bandwidth 
of the monitor 10 is approximately matched to the 
number of pixels on the image sensor array 7. The 
pixel rows are displayed in a non-interlaced fashion 
and at a data rate of 1/60 to reduce flicker. In this 

25 way, one can view individual pixels of the array 
directly without any distortion. 

The computer 12 serves to control various as- 
pects of the present invention and acts as an 
operator input-output device. Very little, if any, data 

30 manipulation is performed by the computer, and 
thus, in a preferred embodiment the computer can 
be any 80386 based personal computer. The com- 
puter also serves as a storage device for images or 
parts of images if required. A variety of mass 

05 storage devices are commercially available, the 
most appropriate being optical memory disk re- 
corders or WORM (Write Once Read Many) re- 
corders due to their large memory capacity and 
non-destructive way of retrieving information. 

40 Focusing of the solid state microscope can be 
achieved automatically under computer control by 
using the frequency information of the detected 
signal. Focus can be defined as the highest fre- 
quency content of the image as measured by a 

45 variety of computer calculated algorithms including 
a Fourier Transformation of the solid state sensor 
signals. Stage controller 13 under computer control 
can move stage 6 in the Z direction in order to 
achieve autofocus. As well, focusing can be done 

so manually by overriding computer control using the 
joystick of stage controller 13. 

Autofocus is also possible while scanning an 
object on stage 5. During scanning, the stage is 
moved in the X and Y directions causing the image 

55 projected onto the solid state image sensor 7 to 
change. In this case, the first rows at the edge of 
the stage image sensor array 7 are used to pro- 
cess data of the newly scanned image, before the 
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object is "seen" by the rest of the pixel elements 
of the two dimensional detector. The processed 
signals of the first few pixel rows are then used to 
correct the focus through computer control of the 
stage 5. While scanning, the edge rows of the 
sensor array are continuously obtaining data for the 
focusing routine of the computer to analyse and 
make appropriate adjustments. This is particularly 
useful when large surfaces are scanned which do 
not lie in an optically flat surface parallel to the 
plane of scanning. 

Alternatively, in a different embodiment of the 
present invention, the objective 6 can.be moved in 
the Z direction either manually or under computer 
control for focusing purpose. 

In use, the various embodiments of the present 
invention have several applications. In its most sim- 
ple and straight forward use. the present invention 
can be used as a conventional microscope accord- 
ing to the embodiments shown in Figure 1 and 4 
where the image of the object being viewed is 
projected through the objective 6 and focused on 
the solid stage image sensor 7. The, signals gen- 
erated by the image sensor are immediately digitiz- 
ed and displayed with a frequency of no less than 
60 Hertz on an RGB analog monitor. Figure 1 
shows an embodiment of the present invention that 
transmits light through the object being viewed. In 
such a transmittance mode, the present invention 
can be used for measuring relative absorbance and 
transmittance of objects. The embodiment of Fig- 
ure 4 uses light reflected from the object being 
viewed to create an image on the image detector 
array. All modes of reflective microscopy are possi- 
ble, similar to those in ordinary microscopy. The 
solid state microscope can be readily adopted to 
measure integrated fluorescence or the distribution 
of fluorescence over an object. 

Using appropriate objectives and/or illumination 
modes of a specimen, phase contrast. Nomarski. 
dark field and other microscopy techniques can be 
performed. It is possible to measure absorbance of 
a specimen by examining the object using both the 
light transmitting and reflecting embodiments of the 
present invention to obtain transmissions and re- 
flective spectra. From these spectra, corrected ab- 
sorbance can be calculated. 

No matter which embodiment of the solid state 
microscope is used, the image acquired by the 
solid state image sensor 7 is processed in real 
time. Figure 3 shows a monitor image of stained 
human red and white blood cells obtained using 
the present invention. The image was calibrated by 
circuit 15 as described previously and filtered by 
image processors 20 using a medium filter to re- 
duce high frequency noise. Employing appropriate 
segmentation techniques available through the im- 
age processors 20, the objects of interest can be 



outlined as contour plots as shown in Figure 3 
where the portion of the monitor screen outlined by 
dashed lines has been processed in such a man- 
ner. 

5 In another embodiment, the present invention 

can be used to generate spectral scanlines of var- 
ious wavelengths of a specimen. This particular 
embodiment of the invention is a modification of 
the solid state microscope of Figure 4 and includes 
io a prism element mounted between the objective 6 
and the solid state sensor array 7. Figure 5 is a 
schematic diagram illustrating the process involved. 
The prism element 30 is positioned in the primary 
image plane covered by a light absorbing material 
75 on surface 32 except in a very narrow band 33 a 
few microns wide, corresponding to the width of 
one row of pixel elements on the CCD array 7. 
Surface 32 of prism 30 faces objective 6 and the 
image 35 of a specimen is projected onto surface 
20 32. Only that portion of image 35 that corresponds 
with narrow band 33 will be transmitted through the 
prism. Therefore, narrow band 33 transmits a -sin- 
gle scanline 36 across image 35 through prism 30 
to image sensor array 7. As scanline 36 passes 
25 through 30 it is broken into a spectrum of. various 
wavelengths. Image sensor array 7 is positioned 
behind prism 30 such that each spectrum 
wavelength is projected onto a row of pixels. This 
spectral information is detected, digitized and fur- 
30 ther processed to produce the spectral diagrams of 
various wavelengths shown on the right of Figure 5 
which are plots of the light intensity at a particular 
wavelength across a particular scanline 36 of im- 
age 35. If necessary this spectral information can 
35 be stored. In Figure 5 a white blood myeloblast ceil 
is being processed according to the above proce- 
dure. If desired, an image of interest can be 
scanned by moving the stage 5 using appropriate 
step sizes to produce a complete set of scanlines 
40 36 across an image 35. For example, a fixed stain 
cell on a microscope slide can be scanned by 
moving the stage 5 in the x direction while the Y 
direction is projected as a scanline 36 onto the 
solid state sensor 7 and stored in memory. Figure 
45 6 shows a composed image created using some of 
the spectral information generated by the above 
scanning procedure. Figure 6 shows a composed 
image as a normalized ratio of two sets of spectral 
lines of approximately 470 nm and 530 nm taken 
so across image 35 of Figure 5. It is possible to image 
any other mathematical function of two or more 
sets of spectral lines of the selected object. 

When using the solid state microscope of the 
present invention individual pixels, sets of pixels 
55 (e.g. are part or the whole of a row or column) or a 
selected area of the single sensor array (e.g. a 
square or a rectangle of pixels) can be specified in 
an addressable form such that only signals from 
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the addressed pixels are processed and displayed. 
In such an application, it is desirable that the two 
dimensional sensing array is a Charge Injection 
Device (CID) which makes random access to local 
areas of the image particularly easy. This selection 
of certain pixels can be achieved under dynamic 
conditions. 

For example, during scanning of a specimen, 
as the stage 5 is moved causing the image projec- 
ted on the solid state image sensor 7 to move 
across the sensor, the first row of pixels is used to 
detect objects of interest and subsequently activate 
a selected area of the two dimensional array where 
a complete image of the object of interest will fall 
at a later time depending on the scanning speed of 
the solid state microscope, in this way, an edge 
row of pixels across the solid state sensor array is 
used as an image detector while the pixel array 
behind the front row is used to capture the image 
to be processed. This is particularly useful when a 
large area is scanned- containing. few objects of 
interest. The front edge row signals of the solid 
state sensor array are used for; coarse feature 
extraction of the object, while the activated area 
within the array is used for fine feature extraction. 
Thus, both coarse and fine features of objects can 
be extracted in one and the same scan. 

This technique of single line detection followed 
by image acquisition is particularly useful for scan- 
ning for unstained live cells growing far apart in a 
tissue culture vessel. Figure 7 showing a solid state 
sensor array divided into rows (i,j) and columns 
(k,l) demonstrates this procedure. As a sample is 
moved on stage 5 in the direction of arrow 40, the 
front row 42 of pixels is used to detect signals 
which are analyzed in real time. If a signal is 
detected indicating an object of interest which war- 
rants examination in 'further detail, an area of pixels 
is activated at a later time which captures the 
image of interest and processes the image exten- 
sively including storage of the image in memory. 
Representative signals generated by objects of in- 
terest will have been previously collected and ap- 
propriate software routines will compare incoming 
signals with representative signals to determine 
when a match occurs. The object of interest is 
"seen* by another portion of the two dimensional 
sensor array after a time delay. Depending on the 
scanning speed and the size of the object of inter- 
est, which can be estimated from the incoming 
data of the first row 42 of pixels, the number of 
pixels and the location of pixels to be activated can 
be determined such that only data belonging to the 
object of interest is collected and processed. In this 
way, only relevant information is processed saving 
time and memory space. In Figure 7, a signal 43 is 
being detected between pixel elements X 1(k and 
Xj,i (where the subscripts represent rows and col- 



umns in the sensor array) causing area 46 of the 
sensor array to be activated at a later time to 
capture the image of the object. 

The solid state microscope of the present in- 

5 vention differs substantially from conventional 
quantitative microscopes. Referring to Figure 8, a 
conventional quantitative microscope system con- 
sists of two or more lens systems and an image 
capturing device 50 which have significant limita- 

10 tions for quantitative microscopy. Objective lens 
system 52 magnifies and projects an image 53 of 
an object 55 onto the primary image plane 56. 
Image 53 is further magnified and optically cor- 
rected with eye projection lens system 58, 60 into 

75 magnified image 62. As shown in Figure 9, the 
quantitative light microscope of the present inven- 
tion positions a solid state image sensor 7 in the 
primary image plane 65 of objective lens 66, there- 
by eliminating the projection lens system and the 

so video camera. Such an arrangement is only work- 
able when the objective and the solid state image 
sensor meet specific requirements. Theoretical 
m work, based on diffraction theory and Fourier the- 
ory, as well as experimental work show that in 

25 order to avoid aliasing, optical distortion, light loss, 
out-of-focus imaging and like problems, the solid 
state microscope of the present invention must 
employ an ultrawide, flat field, high numerical ap- 
erture, highly aberration corrected objective in 

30 combination with a large area, high pixel density, 
solid state image sensor. By meeting these re- 
quirements, the invention of the present application 
allows for acquisition of significantly improved im- 
ages in quantitative microscopy. 

35 The present invention provides a number of 
important technical advantages which can be sum- 
marized as follows: 

V» Simple optical path; 

2. High spatial and photometric resolution; 

40 3. Large field of view; 

4. Minimum loss in illuminance; 

5. Microscope image display on a large 
screen monitor overlayed with graphics for cursor 
measurements; 

45 6. Direct access to any part of the digital 

Image; 

7. Flexibility in scanning modes; 

8. Various means to acquire spectral infor- 
mation; 

so 9. Moves of operation of light transmission, 

absorbance, reflection, scatter and fluorescence. 



Claims 

1. A quantitative light microscope comprising: 
a light source with a condensor and diffusion filter; 
a moveable stage to provide X, Y and 2 displace- 
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ments to position and scan an object under the 
microscope; 

an objective which is highly corrected for aberra- 
tions and with a large numerical aperture and ul- 
trawide flat field to project magnified images of the 
object onto a two-dimensional solid state image 
sensor positioned in the primary image plane of the 
objective, the image sensor having a large sensing 
area with a high pixel density and generating sig- 
nals corresponcing to the spatial distribution of the 
luminance levels of the images; 
an analog-to-digital converter associated with the 
solid state image sensor to digitize and process the 
signals of the solid state image sensor in order to 
provide digital images of the object; 
calibration and correction means coupled to said 
analog-to-digital converter for enhancement of the 
digital images and to account for optical and detec- 
tion induced distortions; * 

a frame memory coupled to said calibration and 
correction means into which the digital images are 
continuously downloaded; 

image processors associated with the frame mem- 
ory for processing the digital images into a display 
image; and 

display means coupled to the frame memory for 
displaying the image. 

2. A microscope as claimed in claim 1 includ- 
ing a computer or microprocessor serving as the 
system controller and as an operator input-output 
device, said computer having a mass storage de- 
vice for storing the digital images of the frame 
memory. 

3. A solid state microscope as claimed in claim 
1 in which said light source, condensor, and diffu- 
sion filter are positioned so as to transmit light 
through the object being viewed. 

4. A microscope as claimed in claim 1 in which 
said light source, condensor, and diffusion filter are 
positioned so as to reflect light from the object 
being viewed. 

5. A microscope as claimed in claim 1 in which 
said solid state image sensor is a two-dimensional 
charge-coupled device (CCD) larger than 1000 X 
1000 pixels having a pixel density larger than 
10,000 pixels per square millimeter. 

6. A microscope as claimed in claim 1 in which 
said display means is a high resolution monitor. 

7. A microscope as claimed in claim 1 in which 
a prism element is positioned in the primary image 
plane in front of the solid state image sensor, said 
prism element allowing only a single horizontal 
scanline to be projected onto the image sensor, 
this single scanline being broken in the vertical 
direction into spectral lines by the prism so that 
each point of the scanline is projected onto a 
different row of the solid state image sensor, the 
spectral line information being digitized and stored 
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in the frame memory. 

8. A method of scanning an object using a 
microscope comprising: 

a light source with a condensor and diffusion filter; 
s a moveable stage to provide X, Y and Z displace- 
ments to position and scan an object under the 
microscope; 

an objective which highly corrected for aberrations 
and with a large numerical aperture and ultrawide 

w flat field to project magnified images of the object 
onto a two-dimensional solid state image sensor 
positioned in the primary image plane of the objec- 
tive, the image sensor having a large sensing area 
with a high pixel density and generating signals 

;5 corresponding to the spatial distribution of the lu- 
minance levels of the images; 
an analog-to-digital converter associated with the 
solid state image sensor to digitize and process the 
signals of the solid state image sensor in order to 

20 provide digital images of the object;' 

calibration and correction means coupled to said 
analog-to-digital converter for enhancement of the 
digital images and to account for optical and detec- 
tion induced distortions; 

25 a frame memory coupled to said calibration and 
correction means into which the digital images are 
continuously downloaded; 

image processors associated with the frame mem- 
ory for processing the digital images into a display 

30 image; and display means coupled to the frame 
memory for displaying the image; 
a prism element between the solid state image 
sensor and the moveable stage positioned in the 
primary image plane; 

35 the method being used to obtain spectral informa- 
tion about an object and the method comprising: 
projecting an image of the object onto the prism, 
the prism allowing only a single scanline to be 
transmitted to the image sensor, this single scan- 

40 line being broken into spectral lines of different 
wavelengths by the prism; 

positioning the image sensor such that different 
spectral lines are projected onto different rows of 
detectors of the solid state image sensor: 
45 digitizing and storing the different spectral lines in 
frame memory: 

moving the stage to scan the next line of the 
object; and 

repeating the above steps until the entire object 
so has been scanned to create sets of spectral lines 
of different wavelengths. 

9. A method as claimed in claim 8 involving 
combining two or more sets of spectral lines of an 
object using a mathematical function to create a 

55 spectral image of the object. 
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